BioNLP'09 Shared Task on
Event Extraction
in conjunction with BioNLP, a NAACL-HLT 2009 workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home] [Evaluation Methods] [Master Result Table] [Team Profiles] [System Profiles]

Final Evaluation Results
on REG-TOTAL events by Approx. Span & Recur. matching

Task 1

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[ UTurku  ]       ==[REG-TOTAL]==       1653 (  589)     1282 (  588)    35.63    45.87    40.11
[ConcordU ]       ==[REG-TOTAL]==       1653 (  454)      910 (  454)    27.47    49.89    35.43
[JULIELab ]       ==[REG-TOTAL]==       1653 (  579)     1694 (  579)    35.03    34.18    34.60
[UT+DBCLS ]       ==[REG-TOTAL]==       1653 (  435)     1038 (  434)    26.32    41.81    32.30
[VIBGhent ]       ==[REG-TOTAL]==       1653 (  287)      908 (  287)    17.36    31.61    22.41
[  UNSW   ]       ==[REG-TOTAL]==       1653 (  274)      962 (  272)    16.58    28.27    20.90
[ UTokyo  ]       ==[REG-TOTAL]==       1653 (  235)      686 (  235)    14.22    34.26    20.09
[ UZurich ]       ==[REG-TOTAL]==       1653 (  245)      811 (  245)    14.82    30.21    19.89
[UAntwerp ]       ==[REG-TOTAL]==       1653 (  183)      613 (  183)    11.07    29.85    16.15
[   Cam   ]       ==[REG-TOTAL]==       1653 (  165)      437 (  165)     9.98    37.76    15.79
[  SCAI   ]       ==[REG-TOTAL]==       1653 (  209)     1263 (  209)    12.64    16.55    14.33
[ Team 24 ]       ==[REG-TOTAL]==       1653 (  155)      801 (  154)     9.38    19.23    12.61
[  NICTA  ]       ==[REG-TOTAL]==       1653 (  129)      712 (  129)     7.80    18.12    10.91
[ UAveiro ]       ==[REG-TOTAL]==       1653 (  104)      494 (  104)     6.29    21.05     9.69
[CNBMadrid]       ==[REG-TOTAL]==       1653 (  202)     2527 (  202)    12.22     7.99     9.67
[CIPS-ASU ]       ==[REG-TOTAL]==       1653 (  196)     2404 (  196)    11.86     8.15     9.66
[ASU+HU+BU]       ==[REG-TOTAL]==       1653 (   86)      257 (   86)     5.20    33.46     9.01
[  UMich  ]       ==[REG-TOTAL]==       1653 (  235)     3581 (  235)    14.22     6.56     8.98
[ USzeged ]       ==[REG-TOTAL]==       1653 (   69)      379 (   69)     4.17    18.21     6.79
[ UNIMAN  ]       ==[REG-TOTAL]==       1653 (   67)      400 (   67)     4.05    16.75     6.53
[CCP-BTMG ]       ==[REG-TOTAL]==       1653 (   51)      106 (   51)     3.09    48.11     5.80
[ Team 09 ]       ==[REG-TOTAL]==       1653 (   40)      336 (   40)     2.42    11.90     4.02
[  PIKB   ]       ==[REG-TOTAL]==       1653 (   18)       59 (   18)     1.09    30.51     2.10
[ KoreaU  ]       ==[REG-TOTAL]==       1653 (   11)       29 (   11)     0.67    37.93     1.31

Task 2

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ]       ==[REG-TOTAL]==       1658 (  427)     1038 (  423)    25.75    40.75    31.56
[UAntwerp ]       ==[REG-TOTAL]==       1658 (  179)      613 (  179)    10.80    29.20    15.76
[ Team 24 ]       ==[REG-TOTAL]==       1658 (  155)      818 (  154)     9.35    18.83    12.49
[ASU+HU+BU]       ==[REG-TOTAL]==       1658 (   85)      257 (   85)     5.13    33.07     8.88
[CNBMadrid]       ==[REG-TOTAL]==       1658 (  161)     2527 (  161)     9.71     6.37     7.69
[CCP-BTMG ]       ==[REG-TOTAL]==       1658 (   50)      106 (   50)     3.02    47.17     5.67

Task 3

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------